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ABSTRACT 



This report discusses the findings of a study that analyzed 
115 public reports from state accountability offices and state special 
education offices to investigate how students with disabilities are doing 
academically and nonacademically . A framework developed by the National 
Center on Educational Outcomes (NCEO) was used to organize results. Analysis 
indicated very limited information on students with disabilities in state 
accountability reports. Almost every state (47) provided data in the academic 
and functional literacy domain, but only 13 reported on students with 
disabilities in this domain. These states provided information on how 
students with disabilities performed on statewide assessments, yet there was 
a range in the amount and types of data presented. In general, the 
performance of students with disabilities was considerably below that of 
students without disabilities. While 38 states reported on students with 
disabilities in the participation domain (graduation or exit data, enrollment 
data, dropout rates, time spent in various settings) , only 12 provided data 
beyond that required for federal reporting. The additional areas were 
participation in large scale assessments and family involvement. Results 
revealed that states are beginning to report on the performance and progress 
of students with disabilities. Appendices include relevant data. (Contains 13 
references.) (CR) 
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Over the past 10 years there has been an increased demand for accountability for the results of 
education for all students, especially students with disabilities. However, very limited data are 
available on educational results for students with disabilities. The Individuals with Disabilities 
Education Act Amendments of 1997 (P.L. 105-17) called for a focus on outcomes, and for data 
to be in public reports. Realizing the importance of accounting for the performance of students 
with disabilities, the National Center on Educational Outcomes (NCEO) analyzed public state 
accountability reports, with the goal of presenting information on how students with disabilities 
are doing both academically and nonacademically according to these reports. 

We collected 115 public reports between October 1997 and March 1998 from state accountability 
offices and state special education offices. Using the NCEO framework to organize results, we 
reproduced the relevant findings to present a picture of what we know about the results of 
education for students with disabilities. 

Our analysis revealed very limited information on students with disabilities in state accountability 
reports. Almost every state (47) provided data in the Academic and Functional Literacy domain, 
but only 13 reported on students with disabilities in this domain. These states provided information 
on how students with disabilities performed on statewide assessments, yet there was a range in 
the amount and types of data presented. In general, the performance of students with disabilities 
was considerably below that of students without disabilities. While 38 states reported on students 
with disabilities in the Participation domain (graduation or exit data, enrollment data, dropout 
rates, time spent in various settings), only 12 provided data beyond that required for federal 
reporting. The additional areas were participation in large scale assessments and family 
involvement. 

Our analysis revealed that states are beginning to report on the performance and progress of 
students with disabilities. The data that do exist confirm suspicions about low performance, but 
do not yet provide information on performance over time. We should see dramatic changes in 
reporting practices when we analyze 1998 state reports. These changes in reporting practices 
will provide the data needed to monitor the progress and performance of students with disabilities. 
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Overview 



Over the past 10 years there has been an increased demand for accountability for the results of 
education for all students, especially students with disabilities. There has also been a push to 
include students with disabilities in school reform activities. While substantial changes have 
been made in education, there is still a concern that reforms and change initiatives have not led 
to satisfactory results for students with disabilities. 

Very limited data are available on the results of education for students with disabilities. The few 
reports available generally have presented a bleak picture of outcomes. Most of these reports 
are from special government studies rather than on-going data collection programs. In the mid- 
1980s, Congress mandated a longitudinal study that reported on the secondary school experiences 
of a sample of students with disabilities, as well as post-secondary outcomes in employment, 
education, and independent living. In this study, Wagner, Newman, D’ Amigo, Jay, Butler-Nalin, 
Marder, and Cox (1991) found that only 15% of students with disabilities attended a post- 
secondary school one year after high school, 30% had not held a paid job, 40% of those employed 
only worked part-time, 1 in 5 overall had been arrested, and nearly 40% of youth left school by 
dropping out. 



• About one-fourth of youth with disabilities had been enrolled in post-secondary vocational 

m schools or 2-year or 4-year colleges by three to five years after leaving high school, almost 

twice as many had been enrolled in the first two years after high school (Wagner, D’Amico, 
® Marder, Newman, & Blackorby, 1992). However, in the general population, nearly 68% of 

H youth were enrolled in some type of post-secondary education. Three to five years after high 

school, only about one in nine students with disabilities had earned some type of post-secondary 
® education degree, certificate, or license. 




Results from the National Adult Literacy Survey (NALS) revealed that adults with any type of 
disability were more likely than those in the total population to perform in the lowest literacy 
levels (Kirsch, Jungeblut, Jenkins, & Kolstad, 1993). The performance gap between those who 
reported having a particular disability and those in the total population ranged from 24 to 154 
points across the scales used. 



More recent analyses of the National Education Longitudinal Study (NELS) of 1988 have shown 
that students identified by teachers and parents as having a disability earned lower high school 
grades in core courses, scored lower on math and reading proficiency tests, and were more 
likely to drop out of school than students without disabilities (Rossi, Herting, & Wolman, 1997). 
Finally, these students also had lower educational expectations for themselves and by their 
parents. The publication of these data and the lack of a more consistent set of data have resulted 
in a call to look more closely at the results of education for students with disabilities, with hopes 
of improving services for these students. 
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There is also limited information about the inclusion/exclusion of students with disabilities in 
large-scale assessments. The NELS 1988 sample of students in eighth grade was estimated to 
have excluded about 5.4% of all potential students due to either limitations in language 
proficiency or to mental and physical disabilities (Ingels, 1996). This was similar to the percentage 
of students excluded from the 1988 NAEP study (5.3 percent) (as cited in Ingels, 1996). It was 
estimated that approximately 2.0 percent were excluded due to language proficiency, leaving 
about 3.4 percent due to mental or physical disabilities. This translates roughly to about 34 
percent of the students with disabilities — meaning that about 66% of these students were included. 
These figures may be overestimates since both studies excluded students in residential and 
separate school placements. 

Policymakers, researchers, educators, and families attempted to address many needed educational 
reforms with the signing of the Individuals with Disabilities Education Act Amendments of 
1997 (P.L. 105-17). This law called for a change in focus from “processes or access to education” 
to “outcomes,” and for major changes in public reporting and accountability procedures 
(Ysseldyke, Thurlow, Kozleski, & Reschly, 1998). As of July 1998, state education agencies 
were required to report on the participation and performance of students with disabilities on 
statewide assessments. 

Numerous states are focusing their efforts on improving reporting practices, but several analyses 
have revealed that many states fall short of what the new requirements mandate. For example, 
a survey of special education directors (Erickson & Thurlow, 1997) indicated that data gathered 
on students with disabilities are not publicly reported in most states, but are used primarily for 
internal review. Only 32 regular and unique states (e.g., Guam, Palau) reported that they have 
readily available information on the number of students with disabilities who participate in any 
of their statewide assessments. Of those states that indicated they report such data, only half 
were able to provide the numbers when requested to do so. Furthermore, the state directors 
pointed to the altruistic motivation of parents and teachers to “protect” students from testing 
and high stakes for schools as the leading reasons for not encouraging students with disabilities 
to participate in assessment programs. It appears that students with disabilities are not encouraged 
to participate in statewide testing even when appropriate, and if they do participate, participation 
data usually have not been reported for them. 

Our goal was to report on how students with disabilities are doing academically and non- 
academically. To do this we used the NCEO framework (Ysseldyke, Krentz, Elliott, Thurlow, 
Erickson, & Moore, 1998) as the basis for our analysis of public state accountability reports. 
NCEO’s framework of educational results goes beyond test participation data. This 
comprehensive framework, initially created by hundreds of nationally-representative 
stakeholders, includes both academic and nonacademic domains (refer to Figure 1). Stakeholders 
identified six domains of desired outcomes, including data on responsibility and independence, 
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Figure 1. NCEO Framework for Educational Accountability 
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personal and social well-being, citizenship, academic and functional literacy, physical health, 
and (student/parent/community) satisfaction. The NCEO framework specifies outcomes, 
indicators, and sources of data in each of the six results domains. The complete framework 
shown in Figure 1 includes Inputs/Resources and Educational Processes, as well as Results, but 
the focus of our analysis was on Results, and certain components of the student-oriented domains 
within Educational Processes. 

Methods 

Data for this report were gathered from public documents that report data on the performance 
of students. The appropriate documents to analyze were identified by using the annual Council 
of Chief State School Officers (CCSSO) state accountability survey as a guide (Council of 
Chief State School Officers, 1997, prepublication copy). This annual survey is sent to state 
accountability offices and used to obtain the titles of each accountability document available 
from the state. Each state accountability office was contacted by NCEO staff and the documents 
listed by CCSSO were requested. In addition, NCEO staff requested any additional information 
specifically on special education that was available from the state. We asked only for published, 
public data, either in paper form or on the World Wide Web. 

Data were gathered between October 1997 and March 1998. Though most reports were obtained 
by the end of November 1997, the last report was collected in March 1998. Since we were 
interested in publicly available accountability data for students with disabilities, we specifically 
requested data from state accountability offices rather than state special education offices. In 
those cases where data were not available on students with disabilities, we also contacted and 
requested any published data from state special education offices. We attempted to obtain every 
available accountability document that included students with disabilities. However, reports 
are continually being produced and sometimes reports available through one unit in a state 
department of education are unknown to another department. Thus, it was difficult to verify the 
extent to which we had obtained all available reports. In some cases, where recent data were not 
obtained in time for our cut-off dates, older data that were available were used. It is important to 
keep in mind that the reports obtained from states spanned the school years 1995-96 through 
1997-98 even though all reports were obtained during 1997-98. 

For this analysis, we obtained 115 accountability reports (see Appendix A). Each report was 
searched thoroughly for data on students with disabilities. Fifty documents contained outcome 
data on students with disabilities. The data were then coded according to the NCEO framework 
(Ysseldyke et al., 1998). Enough data for summary analyses were obtained in only two categories: 
(1) Educational Results for Systems and Individuals, and (2) Educational Processes, specifically 
Student-Oriented Domains. Sporadic data were obtained in other domains of the NCEO 
framework. 
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Wherever possible, data are presented in this report in the same way that states presented them. 
In some cases, data were taken from larger data bases, or from several different sources and 
were formatted in order to increase clarity. The data, however, only include information actually 
stated in the public reports. A summary of cautions about the data included in this report is 
presented in Table 1 . 



Specific Data Included in Each Domain 

Educational Results. Data from three domains were collected in the area of Educational Results: 
Academic and Functional Literacy, Personal and Social Well-Being, and Satisfaction. Most of 
the data included in this area consisted of disaggregated test scores for students with disabilities. 
When reproducing these data we noted when descriptions of the tests were given and when a 
description of the scoring rubrics or standards used to determine proficiency were provided. We 



Table 1 . Cautions 



The data presented in this report do not include: 

• Regular education scores that do include students with disabilities but do not separate out their 
scores. 

• Data that were not part of published, publicly available reports. 

• Data that were not received by March 1 998. 

• Special studies, grants or projects, or data for subgroups of students with disabilities (e.g., students 
with learning disabilities). 

• District or school level data. 

• Preschool data. 

• Post-secondary data unless presented as an outcome of secondary education and included as 
part of a regular or special education accountability report for K-12. 

• Data that are reported in the Annual Report to Congress (U.S. Department of Education, 1997), 
including: 

— Enrollment data. 

— Placement data. 

— Exit status. 

— Personnel and financial data. 

Data in this report do include data from school years 1995*96 to 1997-98. 
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present here the actual data provided, including the scores of students without disabilities for 
comparison, and definitions of terms used if these were part of the accountability documentation. 

Educational Processes. Data from two domains were collected in the area of Educational 
Processes: Participation and Family Involvement. Most of the data reported by states in these 
areas are included in the Annual Report to Congress (U.S. Department of Education, 1997), 
including enrollment, placement, and graduation data. These data are not included in our analysis. 
We do mention, however, when these data are included in public accountability reports, since 
data in these reports are more widely available to the general public than are the data in the 
Annual Report to Congress. When reproducing these data we included the following: 

• Participation in large scale assessments, including, where provided: 

- The number and percentage of students with disabilities who were included or 
excluded from testing. 

- The number and percentage of students who took the test with and without 
accommodations, and the types of accommodations provided. 

• Post high school job placement information. 

• Information on family involvement in students’ education. 

Data not reproduced, but mentioned in this report include enrollment, placement, and students 
with disabilities exiting educational programs. 



Considerations in Interpreting Data 

Every effort was made to gather as much of the publicly available data on students with disabilities 
as possible, and to be fair, thorough, and consistent in data analysis. When interpreting these 
data, it is important to keep these considerations in mind: 

• States gather and report data at different times. We made every effort to report the most 
recent data available; thus, not all of the data provided in this report come from the same 
years. 

• States vary in their: 

- Reporting practices. 

- Types of indicators used. 

- Tests, rubrics and standards used to judge performance. 

- Amount and types of data provided in accountability reports. 
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• In some cases, data are very difficult to interpret because they do not include glossary or 
summary information, the percentages of students with disabilities tested, or other 
information that is needed to accurately interpret the data. 

• These data are intended to be used as a general overview of the performance of students 
with disabilities, and should be interpreted with caution. Comparisons between states 
on the performance of students with disabilities are not appropriate since measures and 
participation rates for students with disabilities are different from one state to the next. 



Results — — ^ 

Of the 115 reports that were analyzed from 50 states, a total of 59 reports (39 states) included 
data on students with disabilities in the domain(s) of academic and functional literacy and/or in 
the student-oriented process domains. The actual data of educational results and processes on 
students with disabilities reported in state accountability reports were collated and are reproduced 
in this document. Because states often produce multiple reports (see Thurlow, Langenfeld, 
Nelson, Shin & Coleman, 1998), we opted to analyze all data in terms of state performance 
(e.g., number of states reporting on test scores or number of students participating in testing). 

The reproduced data are presented, categorized by state and domain, in Appendices B and C. In 
Appendix B are the data on how students with disabilities are doing in domains of Academic 
and Functional Literacy, Personal and Social Well-Being, and Satisfaction. Descriptions of data 
sources are provided if the information was in the reports; not all states provided contextual 
information. Information that states provided on the Student-Oriented Domains of Participation 
and Family Involvement is listed in Appendix C. Again, any clarifying information in the actual 
report(s) is included here. 

A summary of which states report data on educational results and processes is provided in Table 
2. As indicated in the Results area, the most frequent domain for which data were presented was 
Academic and Functional Literacy. Only two states included other areas (Kansas has Personal 
and Social Well-Being data; New York has Satisfaction data as well as Academic and Functional 
Literacy). In the Process area, most states reported on Participation. 



Educational Results 

Thirteen states disaggregated performance data for students with disabilities in the area of 
Academic and Functional Literacy (Connecticut, Delaware, Georgia, Louisiana, Maine, New 
Hampshire, New York, North Carolina, North Dakota, Rhode Island, South Carolina, Texas, 

T3 
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Table 2. Overall Summary of Data Gathered on Students with Disabilities 



State 


Educational Results 
(Academic and 
Functional Literacy, 
Personal and Social 
Well-Being, and 
Satisfaction 


Educational 

Processes 

(Participation, Family 
Involvement) 


AL 




P 


AK 




P* 


AZ 




P* 


AR 






CA 




P 


CO 




P 


CT 


AFL 


P* 


DE 


AFL 




DC 




P 


FL 




P 


GA 


AFL 


P 


HI 




P 


ID 






IL 






IN 




P 


IA 




P 


KS 


PSW 


P 


KY 






LA 


AFL 


P 


ME 


AFL 


P* 


MD 




P 


MA 




P* 


Ml 






MN 






MS 




P 


MO 




P 


MT 






NE 






NV 


(AFL**) 




NH 


AFL 


P* 


NJ 




P 
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Table 2. Overall Summary of Data Gathered on Students with Disabilities (continued) 



State 


Educational Results 
(Academic and 
Functional Literacy, 
Personal and Social 
Well-Being, and 
Satisfaction 


Educational 

Processes 

(Participation, Family 
Involvement) 


NM 




P* 


NY 


AFL/S 


P* 


NC 


AFL 


P* 


ND 


AFL 


P 


OH 




P 


OK 




P 


OR 


(AFL**) 


(FI**) / P* 


PA 




P 


Rl 


AFL 


P 


SC 


AFL 


P* 


SD 




P 


TN 




P 


TX 


AFL 


P* 


UT 




P 


VT 


(AFL**) 


P 


VA 


AFL 


P 


WA 




P 


WV 






Wl 






WY 







Note: AFL = Academic and Functional Literacy; PSW = Personal and Social Well-Being; S = Satisfaction; 
P = Participation; FI = Family Involvement. 

* These states reported participation in large-scale assessments. 

** These states only reported information that was gathered from a special study, not an annually reported 
indicator. 



Virginia). These states provided information on how students with disabilities performed on 
statewide assessments. Generally, the data are for one year only. There is very little information 
included in state accountability documents on how students with disabilities are performing 
over time and whether there is improvement or progress in performance from year to year. 

Three states (Nevada, Oregon, Vermont) completed special studies on the academic and functional 
literacy of students with disabilities. (These unique indicators that were reported are not gathered 
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annually.) For example, Vermont reported the results of a pilot study on the outcomes of IEP 
interventions for special education students. 

Two states reported on other domains of results for students with disabilities. Kansas, the only 
state to report on the area of Personal and Social Well-Being, cited the number of violent acts 
committed by students with disabilities. New York reported data in the domain of Satisfaction: 
the results of a Consumer Satisfaction Survey on vocational rehabilitation services provided to 
special education students. 

For the 13 states that presented information on statewide assessments, the most frequently 
reported content areas (see Table 3) were: reading (12 states) and math (11 states). Only six 
states reported social studies data. Ten states reported on students with disabilities in three or 
more content areas (Connecticut, Georgia, Maine, New Hampshire, New York, North Carolina, 
North Dakota, Rhode Island, South Carolina, Texas). 

According to CCSSO (1998), 19 states had a high stakes graduation exit exam in 1997. Fifteen 
of these states reported graduation exam results for regular education students (Florida, Georgia, 
Indiana, Louisiana, Maryland, Mississippi, New Jersey, New Mexico, New York, North Carolina, 
Ohio, South Carolina, Tennessee, Texas, Virginia), and only 47% of the 15 states (7 states: 
Georgia, Louisiana, New York, North Carolina, South Carolina, Texas, Virginia) reported these 
results for students with disabilities. 

Only a handful of states presented any other types of data in the domain of Academic and 
Functional Literacy. Georgia reported the results of retests on its graduation exam. New York 
and Texas both provided extensive data on students with disabilities in the area of Academic 
and Functional Literacy. These two states have state assessments in place, a graduation exam, 
and end-of-course assessments that include students with disabilities. Furthermore, both of 
these states have other unique indicators in this domain. New York has an Occupational Education 
Proficiency Exam. Texas has an assessment, the Texas Academic Skills Program Test (TASP), 
that provides results of college entrance exams for students entering Texas institutions of higher 
education. Both of these states provided clear and concise data on students with disabilities and 
should be viewed as models for their reporting practices. 

A synthesis of the state achievement test data of students with disabilities is presented in Table 
4. Because it is difficult to aggregate and analyze achievement data of states due to differences 
in tests, standards, rubrics, the time of year given, content difficulty of tests, accommodations 
given, exclusion of students, the grade the test was given, or the year the data were collected, 
we decided to examine how students performed relative to standards set by the states. We used 
the percentage of students above the passing score or other index of “adequate” performance. 
As indicated in Table 4, approximately 30-50 percent fewer students with disabilities are meeting 
standards than are students without disabilities. Looking at score results within states, students 
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Table 3. Educational Results: Summary for Academic & Functional Literacy, Personal and 
Social Well-Being, and Satisfaction 



State 


Content Areas 


Graduation 

Exam 


End-of-Course 

Assessments 


Other Unique 
Indicator(s) 




Rdg/ 

Lang 


Math 


Writ 


Sci 


s. s. 








AL 


















AK 


















AZ 


















AR 


















CA 


















CO 


















CT 


• 


• 


• 












DE 






• 












DC 


















FL 


















GA 


• 


• 




• 


• 


• 






HI 


















ID 


















IL 


















IN 


















IA 


















KS** 


















KY 


















LA 


• 


• 








• 






ME 


• 


• 


• 


• 


• 








MD 


















MA 


















Ml 


















MN 


















MS 


















MO 


















MT 


















NE 


















NV 
















Provides a matrix of 
characteristics of 
schools (% of SpEd) 
and their effects on 
test scores (+ or -)* 


NH 


• 


• 




• 


• 








NJ 


















NM 
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